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DOCKET NO: 12128-061001 

EMBEDDING SAMPLE VOICE FILES IN VOICE OVER IP (VOIP) GATEWAYS 
FOR VOICE QUALITY MEASUREMENTS 

BACKGROUND OF THE INVENTION 

The invention relates to voice call quality testing. 

Packet-based networks, in particular^ Voice Over IP 
(VOIP) networks, are rapidly emerging as a viable alternative 
to traditional telephony (that is, circuit switched networks) . 
VOIP is viewed as an attractive option for voice transport in 
that it allows live voice conversations to be integrated with 
existing IP data and image applications. To be a truly 
competitive alternative, VOIP must emulate the performance of 
traditional telephony and do so using a protocol that was 
optimized for data traffic. The characteristics of data 
traffic are quite different from those of voice traffic, 
however . 

Unlike data traffic, voice traffic is extremely 
intolerant of delay and delay variation (or ^^jitter'') , as well 
as packet loss. Much work has been done in the area of packet 
delivery to provide end-to-end Quality of Service (QoS) . 
Service level agreements (SLAs) for VOIP, like those for 
conventional data IP networks, therefore tend to be based on 
conventional data network metrics, that is, guaranteed service 
levels are expressed solely in terms of packet level 
performance, e.g., packet loss, delay, jitter. 

Another important aspect of voice communications 
quality that is not reflected in the data network metrics, 
however, relates to the sound of a voice call from the 
perspective of the listener. Standardized techniques exist for 
measuring this aspect of voice quality. Typically, to support 



voice communications;. VOIP networks encode the audio and format 
the encoded audio into packets for transport using an IP 
protocol. Consequently, the results of these voice quality 
tests are greatly affected by choice of speech coding 
5 techniques. 

One approach utilizes a standardized ranking system 
called the Mean Opinion Score (MOS) . The MOS system uses a 
five-point scale: excellent-5; good— 4; fair-3; poor-2; and 
bad-1. A level of quality indicated by a score of 4 is 
10 considered to be comparable to ''toll quality''. A number of 

people listen to a selection of voice samples or participate in 
S conversations, with the speech being coded by using the 
;2 technique to be evaluated. They rank each of the samples or 
ffl conversations according to the five-point scale and a mean 
Jls score is calculated to give the MOS. Although the applicable 
ff' ITU standard, ITU-T P. 800, makes a number of recommendations 

Si 

□ regarding the selection of participants, the test environment, 
S'V' explanations to listeners, analysis of results, etc., because 
=p this type of voice quality testing is subjective, results tend 
J5o to vary from test to test. 

Algorithms for performing a more objective voice 
quality test have been developed as well. These objective 
techniques for testing voice transmissions in packet-based 
networks include an ITU standard based algorithm known as 
25 Perceptual Speech Quality Measurement (PSQM) and Perceptual 
Analysis Measurement System (PAMS) , which was developed by 
British Telecom, Both of these perceptual test algorithms 
evaluate whether a particular voice transmission is distorted 
from the perspective of a human listener. 
30 PSQM takes a ''clean'' voice sample and compares it to 
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a potentially distorted version, that is^ a transmitted 
version, using a complex weighting that takes into account what 
is perceptually important to a human listener, for example, the 
physiology of the human ear and cognitive factors related to 

5 what human listeners are likely to notice. PSQM provides a 
relative score (on a scale of 1 to 15, with 1 corresponding to 
the highest score and 15 corresponding to the lowest score) 
that indicates how different the distorted signal is with 
respect to the reference from the perspective of the human 

10 listener. 

PAMS is based on a perceptual model similar to that 

?0 of PSQM and shares with PSQM the purpose of providing a 

IB ^ . . , . , 

if? repeatable, ob^ectxve means for measuring voice quality, but 

(''^■'^ uses a different signal processing model than PSQM and produces 

f||15 a different type of score as well. The scoring provided by 

PAMS includes a ''listening quality" score and a ^'listening 

Si 

6 effort'' score, both of which correlate to the MOS scores and 
iJ, are on the same scale of 1 to 5. 

U 20 SUMMARY OF THE INVENTION 

In one aspect, the invention provides methods and 
apparatus, including computer program products, for testing 
voice call quality in a Voice Over Internet Protocol (VOIP) 

25 network. The methods include enabling a communications device 
connected to the VOIP network to answer a test call received 
over the VOIP network by playing a voice file, generating a 
test call over the VOIP network to the communications device 
and measuring voice call listening quality from the voice file 

30 played by the communications device. 
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Particular implementations of the invention may 
provide one or more of the following advantages- Only one 
piece of voice call quality test equipment (or test probe) is 
needed to test an entire VOIP network^ as communication devices 
5 such as gateways are able to respond to test calls initiated by 
that test probe. Consequently^ voice call quality test 
configurations are simplified and less expensive to implement. 

Other features and advantages of the invention will 
be apparent from the following detailed description and from 
10 the claims. 

j BRIEF DESCRIPTION OF THE DRAWINGS 

W FIG. 1 is a block diagram illustrating a Voice Over 

Lol5 IP (VOIP) network voice call listening quality test topology. 

FIG. 2 is a block diagram of an exemplary VOIP- 
0 telephony network that employs the test topology of FIG. 1. 
'''^ FIG. 3 is a detailed illustration of an exemplary 

VOIP Point of Presence (POP) . 
20 FIG. 4 is an illustration of a VOIP gateway 

configuration supporting voice call listening quality testing 
for a VOIP network. 

FIG. 5 is an alternative embodiment of the test 
topology of FIG. 1. 
25 FIG. 6 is a VOIP- telephony network that employs the 

test topology of FIG 5. 

DETAILED DESCRIPTION 
30 Referring to FIG. 1, an exemplary voice quality 
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network test topology 10 includes a packet-based network shown 
as an IP network 12 that transports voice traffic- The 
network test topology 10 further includes voice quality test 
probes 14a and 14b^ which are coupled to gateways 16a and 16b, 
5 respectively. The gateways 16a and 16b each are connected to 
the IP network 12 and provide translation services between 
protocols of the IP network and a conventional telephony 
network, such as a Public Switched Telephone Network (or 
^'PSTN") . The test probe 14a is connected to the gateway 15a 
10 by a first telephony transmission line, shown as an ISDN line 
18a (e.g., El or Tl) , and uses an ISDN Primary Rate Interface 
(PRI) service. The test probe 14b is connected to the gateway 
16b over a second telephony transmission line 18b, also shown 
m as an ISDN line 20b supporting ISDN-PRI service. Other PSTN 

ffl5 physical and signaling interfaces can be used. For example, 

111 

fH the lines 20a, 2Gb may be ISDN-BRI or CAS Tl/El lines. 

Alternatively, the lines can be implemented as analog FXO 

W] wires. Because the IP network 12 transports voice traffic, it 
is also referred to as a Voice Over IP (VOIP) network and IP 

f'^O communication devices coupled to the VOIP network 12 either 
directly (such as the gateways 16a, 16b) or indirectly 
(through another IP communications device) are also referred 
to as VOIP communications devices. 

The test probes 14a, 14b store a sample or reference 
25 voice file 22a, 22b, respectively, for test purposes. The 

reference voice file 22 is formatted as a typical audio file, 
e.g., RIFF WAVE '''^.WAV" file (as shown), or some other audio 
format. The test probes 14a, 14b also store a software 
algorithm implementing a perceptual or voice call listening 
30 quality test model. In one embodiment, the software algorithm 
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is the Perceptual Analysis Measurement System (PAMS) 
algorithm. Other objective, repeatable voice call listening 
quality test algorithms, e.g.. Perceptual Speech Quality 
Measurement (PQMS), can also be used. Although one of the two 
5 test scores produced by PAMS is known as '"listening quality'', 
the term ^^voice call listening quality'' as used herein refers 
to the quality measured by any perceptual voice call test 
technique, such as PAMS (and therefore encompasses both the 
PAMS '"listening quality" as well as the PAMS ''listening" 
10 effort") or PQMS , The test probes 14a, 14b can store any type 
of reference voice file, but the voice file stored on both of 
:S the test probes 14 as the reference voice file must be 
K identical in order for the PAMS (or other similar) voice call 
IM listening quality testing to work correctly. Preferably, for 
rjll5 optimum test results, the voice file should include voice 
p samples representative of many different types of voice 
p activity. 

In operation, the test probes 14 transmit and 
£ receive the reference voice files (test. WAV files 22a, 22b) 
2 20 over the speech path within the VOIP network. One test probe 
acts as a resource to transmit the file. A second test probe 
acts as a resource to receive the file transmitted by the 
first test probe and perform the PAMS algorithm. For example, 
the test probe 14a, serving as a "'call initiator", dials a 
25 telephone number corresponding to the other test probe, the 
test probe 14b (acting as a "call responder") . The VOIP 
gateway 16a directs the call over the VOIP network 12 to the 
VOIP gateway 16b, which sends the call to the test probe 14b. 
The test probe 14b answers the call by playing back to the 
30 caller, that is, test probe 14a, the stored reference voice 
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file. The test probe 14a records the played voice file as it 
^'listens'' and analyzes the voice quality of the recorded voice 
file using the PAMS algorithm. The PAMS algorithm compares 
the recorded voice file to the reference voice file stored by 
the test probe 14a and determines a difference between the 
files. When the analysis is complete^ the test probe 14a 
translates the difference into a PAMS score (actually^ a two- 
part score having separate scores for listening quality and 
listening effort) for the voice quality of the call- It will 
be understood that the same process can be used in the reverse 
direction, that is, when the test probe 14b acts as the call 
initiator and the test probe 14a acts as the call responder. 
The test probes 14 may be configured to allow a test 
administrator to view the resulting scores graphically or in 
some other form. 

Preferably, the voice call listening quality test is 
performed for each level of service as determined by the type 
of codec (i.e., coder/decoder) that is used by the VOIP 
communications device that is performing the voice encoding 
and decoding operations. In the network shown in FIG. 1, the 
gateways 16 implement one or more coding schemes to support 
voice encoding/decoding. 

Categories of available codecs include, but need not 
be limited to, the following: waveform codecs, source codecs 
(or vocoders) and hybrid codecs. Waveform codecs sample and 
code an incoming analog signal without regard to how that 
signal was generated. Quantized values of the samples are 
sent to the destination, where the original signal is 
reconstructed at least to a good approximation. Waveform 
codecs produce high quality output but require a significant 



amount of bandwidth. Source codecs attempt to match an 
incoming signal to a mathematical model of how speech is 
produced. The information that is transmitted is a set of 
model parameters rather than a representation of the signal. 
5 The destination uses the model parameters to reconstruct the 
analog signal. This type of codec operates at low bit rates 
but tends to produce speech that sounds synthetic^ and 
therefore is not generally used in public networks. Hybrid 
codecs attempt to combine that best of both waveform and 
10 source codecs. They perform some degree of waveform matching^ 
but also use knowledge of how the sounds were generated in the 
5 first place. They tend to provide quite good quality at lower 
ID bit rates than waveform codecs. 

The G.711 Pulse-Code Modulation (PCM) coding 

f^5 technique is a waveform codec and is one of the most common 

y I 

p coding techniques that are used. It is the codec of choice 
^ for circuit-switched telephone networks . Other PCM waveform 
IJl codecs include 6.726;. which offers Adaptive Differential PCM 
„£ (ADPCM) coded speech. Lower bandwidth, hybrid codecs include 
p20 the G.723 and G.729 codecs. 

The choice of codec is a major factor in high voice 
quality and voice quality test scores will vary with codec 
selection. The goal of any network operator or service 
provider is to offer '^toll quality'' voice, where toll quality 
25 voice relates to a MOS of 4.0 or better. The task of 

selecting the best codec for a given network is a matter of 
balancing quality with bandwidth consumption. Thus, it is 
desirable to test different codecs in an environment that 
closely matches expected network conditions. 
30 Still referring to FIG. 1, the test topology 12 
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tests for three different coding techniques, G,711, G.723 and 

although other coding schemes can be used in addition 
to, or lieu of, any one or more of these techniques. That is, 
each of the gateways 15 is capable of encoding and decoding in 
5 accordance with these different coding techniques- 

Consequently, there is a different phone number for each test 
probe and service level combination. 

Optionally, in addition to measuring voice call 
quality on a per-codec basis, test probes 14 can test voice 
10 call quality on a per-protocol basis as well. That is, it is 
possible to further associate each test probe phone number and 
service level combination with each protocol supported by the 
CO VOIP communications devices 16. For example, commercially 

available gateways support such signaling protocols as H.323 
^"^15 and Session Initiation Protocol (SIP) , as well as Media 
sjl Gateway Control Protocol (MGCP) . Other existing protocols, 
■U such as media gateway control protocol (MEGACO/H . 248 ) , as well 
\i\ as other protocols, may be supported as well. The protocol- 
X specific testing could measure, for example, voice call setup 
]-^20 and tear-down times. 

For example, to illustrate service level selection 
based on both codec and IP signaling protocol, each of the 
test probes 14 may be assigned four unique telephone numbers. 
The four unique phone numbers include: a first unique phone 
25 for a service level associated with the use of G.711 coding 

and H.323 signaling; a second unique phone for a service level 
associated with the use of G.723 coding and H.323 signaling; 
and third unique phone number for a service level associated 
with the use of G.711 coding and SIP signaling; and a fourth 
30 unique phone number for a service level associated with the 
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use of G.723 coding and SIP signaling. To place a call to the 
test probe 14b, the test probe 14a initiates a call to one of 
the four unique phone numbers for the test probe 14b with the 
gateway 16a. Gateway 16a is configured with resources to 
perform both types of coding and signaling, but selects the 
appropriate coding for the call to the test probe 14b and call 
signaling to establish a connection with the gateway 16b based 
on the phone number. Typically, the gateways include a 
configuration table which stores the called phone numbers with 
associated service level information for look-up, as will be 
described in further detail below. Thus, the gateway 16a 
determines from the service level information associated with 
the called phone number (for test probe 14b) how the audio is 
to be encoded and how the data connection is to be 
established. When the connection between gateway 16a and 16b 
is established, the gateway 16b is able to detect the type of 
coding in use and allocate an appropriate coding resource to 
encoding the audio when it is receives the voice file 
transmission from the test probe 14b. 

Although not shown, it will be understood that the 
test probes 14 further include the necessary hardware and 
software required to support applicable network layer 
protocols. In addition, and specifically in support of voice 
call quality testing, each test probe 14 includes a call 
generator. In one embodiment, the call generator provides a 
complete H.323 implementation package that is capable of 
initiating and responding to calls. The package thus 
simulates an H.323 terminal generating calls with (or without) 
a VOIP gateway, as well as opening logical channels and 
transmitting RTP voice packets. Other VOIP protocols, such as 
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SIP and MGCP (as discussed above) , can be used instead of or 
in addition to H.323. 

As indicated above^ the test probes 14 are 
configured to perform automated voice quality measurements on 
a voice transmission and produce a score based on those 
measurements • This testing may be performed in a laboratory 
environment to simulate conditions of an operating network;, o 
as part of the actual network operation, as will be described 
with reference to FIG- 2. 

FIG. 2 depicts an exemplary telephony- VOIP network 
30. The exemplary network 30 illustrates how the test 
topology of FIG. 1 is adapted for use in a production 
environment. The network 30 deploys a number of test probes 
like the test probes 14 (FIG. 1), indicated by reference 
numerals 14a through 14f, at different points along the borde 
of the VOIP network 12. Although not shown in the figure^, 
each of the test probes in configured with a copy of a 
reference voice file, as described earlier with reference to 
the reference voice files 22 of FIG. 1. Each of test probes 
14a through 14d is connected to a respective one of gateways 
16a through 16d. Also connected to the gateway 16c is a 
server 31. Each of the gateways 16a through 16d is connected 
to the VOIP network 12 and a respective one of PSTNs 32a 
through 32d. In addition to the gateways 16, VOIP 
communications devices include a VOIP server 34 and a VOIP 
telephone 36. The test probe 14e is connected to the VOIP 
server 34 and the test probe 14f is connected to the VOIP 
telephone 36. Each of the test probes 14 is controlled to 
generate test calls to others of the test probes 14 over the 
VOIP network 12, perform PAMS testing on the voice files 



played back in response to the test calls, as well as play a 
reference voice file when acting as a recipient of a test 
call, much in the same manner as was described for the two 
test probes shown in FIG. 1. 

The test probes 14 attach to VOIP communications 
devices, such as devices 16, 34 and 36, through digital or 
analog circuits. In addition, or alternatively, test probes 
can be deployed at other locations for different types of 
voice quality (and possibly packet-based) test coverage. For 
example, active test probes can connect to PSTNs through 
telephony interfaces for end-to-end voice quality testing, 
like test probes {TP2) 40a, 40b, which are connected to PSTNS 
32c and 32d, respectively, or can connect directly to the VOIP 
network 12 through an IP interface and appear to the VOIP 
network 12 as another gateway, or some other VOIP 
communications device. The latter configuration, an example 
of which is illustrated by test probe TPl 38, only tests the 
VOIP network, not the gateway, however. A ^^passive" test 
probe may be connected between the gateways 16 (or other VOIP 
communications devices) and the VOIP network 12 to produce 
information for all of the voice calls it sees, in particular, 
packet-based and voice quality information for all of the 
voice calls and PAMS data for probe-generated voice calls. 
Test probe {TP3) 42, which is coupled between the gateway 16b 
and the VOIP network 12, is an example of a passive test 
probe . 

All of the test probes store a copy of the same 
reference voice file and have the capability to generate PAMS 
scores for test call traffic. All but passive test probes can 
generate and answer test calls in the manner described above. 
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Unlike the other probes, the passive probe TP3 42 sees all 
voice calls, including test calls. It is able to identify a 
test call by a caller's IP address or the called phone number. 
Once a test call is detected, the passive probe can extract 
the audio from a test call and apply a PAMS test to it. 
Consequently, the passive probe provides a test result for a 
network location intermediate the call source and destination 
points. A combination of end-to-end scores, border-to-end (or 
border) scores, as well as a passive probe scores, therefore 
enables a test administrator to isolate a network trouble 
spot . 

In addition to PAMS testing, the end-to-end voice 
quality testing test probes 40 also include software to 
support other active test measurements for signaling and voice 
quality, including: post dialing delay; post gateway answer 
delay; background noise; audio level; insertion loss; round 
trip delay; echo and DTMF integrity. 

The VOIP communications device test probes, such as 
test probe 38, can perform, in addition to the PAMS tests, the 
following signaling and voice quality tests: Q.931 setup 
time; RTP setup time; background noise; audio level; and 
insertion loss. The software can also simulate various packet- 
based impairments (e.g., jitter, total packet loss, packet 
loss burst, etc.) and assess their effects on the VOIP and the 
VOIP communications devices, e.g., the VOIP gateways 16. The 
voice quality measurements by the VOIP communications device 
test probes can be end-to-edge or edge-to-edge. 

In addition to performing voice quality tests on 
PAMS-generated traffic, passive test probes, such as the test 
probe 42 can support, for all live traffic monitored on the 
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VOIP network 12, the following active test measurements: call 
statistics; setup time; jitter per RTP stream; and packet loss 
(and packet loss burst) per RTP stream. 

Thus^ the deployment of the various types of probes 
throughout a network such as network 30 provides for a 
network-wide monitoring system. The different types of test 
probes, that is, the test probes 14, 38, 40 and 42, and the 
manager 4 4 shown in FIG. 2 may be implemented using 
commercially available hardware and software, for example, 
using the various components of the Omni-Q Voice Quality 
Management System manufactured by and available from RADCOM. 

Still referring to FIG. 2, also connected to the 
VOIP network 12 is a management server (or manager) 44. All 
test probes in the network 30 are configured and controlled by 
the manager 44. The manager configures the test probe 
properties and test call generation schedules, as well as 
establishes alarms or thresholds to ensure delivery of service 
in accordance with Service Level Agreements (SLAs) . It polls 
the probes on a periodic basis to gather test results, 
consolidates the test results for the entire network and 
stores the consolidated information in a database for 
analysis, reporting and historical trending. 

In one exemplary commercial setting, the VOIP 
network infrastructure of the network 30 is maintained by a 
VOIP network operator (or wholesale service provider) and made 
available to that VOIP network operator's customers, e.g., 
retail service providers who use the infrastructure and 
related services of the VOIP network operator to provide 
services to end-users. The network operator manages the VOIP 
network infrastructure and related services using the manager 
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44. In a large-scale operation, the network operator supports 
a large number of VOIP Points of Presence (VOIP POPs), an 
example of which is indicated in dashed lines as VOIP POP 46, 
in different geographic regions for coverage of a larger 
territory, e.g., national level coverage. Each VOIP POP 
provides a point of entry to and termination from the VOIP 
network backbone. The network operator supports outbound call 
completion to the PSTNs for calls placed over the VOIP network 
and inbound call delivery for calls initiated on the PSTN for 
delivery over the VOIP network. An example of such an inbound 
service may be delivery of calls from end-users to a 
customer's unified messaging server. To support such a 
service, the network operator provides a block of local Direct 
Inward Dial (DID) numbers to the customer so the customer has 
local access capability in a particular geographic market. A 
call from an end-user to one of the DID numbers results in a 
call passing through a gateway associated with that number to 
the customer's server (via a gateway hosting that customer). 
Examples of other inbound call services include, for example, 
conference call bridging, call delivery to call centers and 
call waiting servers. The network operator provides service 
level agreements based on voice call quality, which includes 
voice call listening quality metrics (i.e., test score values) 
as well as packet-based metrics, as described above. 

Referring to FIG. 3, a network 30' having an 
exemplary VOIP POP 4 6' that supports inbound service delivery 
and service level based voice call quality testing is shown in 
detail. In this example, the VOIP POP 46' includes multiple 
gateways 16-1, 16-2,... 16-8 to support different metropolitan 
areas, including San Francisco, Los Angeles and San Diego (as 
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shown) . The closest Internet access point is located in Los 
Angeles, so traffic from San Francisco and San Diego is 
directed to Los Angeles, where it is passed to an Internet 
backbone router 50. Each gateway 16 in each metropolitan area 
has multiple connections 52 to support customer traffic and at 
least one gateway 16 in each area supports a single connection 
54 for connecting to one of three test probes 14-1, 14-2 and 
14-3. The connections 52 in each area connect a respective 
PSTN to that area's gateways 16. Thus, the two gateways in 
San Francisco, the gateways^ 16-1 and 16-2, are connected to a 
PSTN in San Francisco (SF PSTN), 32-1, and the gateway 16-1 is 
also connected to the test probe 14-1. The four gateways in 
Los Angeles, the gateways, 16-3, 16-4, 16-5 and 16-6, are 
connected to a PSTN in LA (LA PSTN), 32-2, and the gateway 16- 
6 is also connected to the test probe 14-2. With respect to 
San Diego, the gateways 16-7 and 16-8 are connected to a PSTN 
in San Diego (SD PSTN), 32-2, and the gateway 16-8 is also 
connected to the test probe 14-3. 

In the illustrated example, and as discussed above, 
the VOIP network operator enables customers to deploy their 
services on a national level without having to make an 
investment in network infrastructure. Blocks of local DID 
numbers are made available to customers for use by end-users. 
In this example, it is assumed that one of the San Francisco 
gateways 16-1, 16-2 is configured to handle phone numbers 
having an area code 'M08" and a three-digit exchange of ''123'', 
followed by a four-digit number in the range of 1000-3000. 
Two customers, customers A and B, wish to service users in the 
San Francisco area and thus require blocks of local DIDs to 
give to customers in that area. The identified gateway 
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therefore serves as a central office and all the inbound 
traffic is aggregated to a single connection point. 

In general, and referring to FIG. A, the gateways 16 
maintain a configuration table 60 that includes, for each of a 
5 plurality of profiles 61, a phone number 62, an associated 

service level 64 and routing information 66. At minimum, the 
service level 64 indicates the coding scheme to be used by the 
VOIP communications devices responsible for establishing the 
IP data path over which the voice transmission is to occur. 
10 The routing information 66 identifies by IP address a hosting 
gateway or server to which inbound traffic associated with the 
d phone number 62 is to be directed. 

]5J As an example, and thus intended for illustrative 

fl purposes only, the second, third and fourth table entries are 
&^15 populated with data to support configurations for inbound VOIP 
calls for the two customers, customer '"A" and customer "'B", 

-p. - 

^ and SF test probe 14-1 via one of the gateways 16-1, 16-2 
m (FIG. 3) . Numbers in the 1000-1999 range are allocated to 
•J customer A, who has requested G.711 service. The numbers in 
©O the range of 2000-2999 are allocated to customer B, who has 

requested G.723 service. The ''3000'' number is assigned to the 
test probe 14-1 for a specific service level, for example, 
G.711. 

Referring to FIGS. 3 and 4, when one of the San 
25 Francisco gateways, say, 16-1, configured with the 

configuration data shown in the configuration 60, detects an 
in-coming call from the PSTN 32-1, it parses the configuration 
60 to match the incoming phone number to any of the stored 
phone numbers. If the gateway 16-1 determines that the dialed 
30 number belongs to a particular customer such as customer A, it 
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selects as a service level the service level requested by 
customer A, that is, the G.711 service level (specified by the 
service level field 64). It routes the call to the gateway 
identified by the routing information field 56 for hosting 
customer A, for example, the gateway 15c (shown coupled to the 
server 31, representing customer A), using the G.711 service 
level. A call belonging to customer B is handled in much the 
same way, but according to the specific configuration 
information for customer B. That is, the call is routed to a 
hosting gateway or a server for customer B, shown in the 
figure as the server 34, using the G-723 service. If the 
dialed number is 4 08-123-3000, the gateway 15-1 determines 
from the configuration 50 that the call is a test call to be 
placed to a test probe, for example, the test probe 14d, using 
G.711 service. At this point, the process is as described 
above with reference to FIG. 1. 

As already indicated, the manager 44 is operated by 
the IP services provider to control the test probes deployed 
throughout the VOIP network 12. The manager 44 determines the 
frequency with which the test probes make test calls and 
schedules the test probes to generate and receive the test 
calls. It polls the test probes for test results (MOS scores) 
and is able to process the raw data for reporting, network 
repair /enhancements, and so forth. For example, the manager 
44 can determine an average score from all of the test calls 
for each service level, that is, G.711, G.723 and G.729, 
during a given time period (e.g., on a monthly basis) and 
compare that average performance metric to a guarantee 
provided by an SLA between the VOIP network operator (service 
provider) and a service subscriber (such as the hypothetical 
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customers A and B in the above-described example) . 

Other embodiments of the voice quality testing 
topology and VOIP-telephony network of FIGS. 1 and 2, 
respectively, are contemplated. For example, and referring to 
5 FIG. 5, a voice quality test network topology 70 includes the 
VOIP network 12 and coupled to the VOIP network 12 are a test 
probe 72 and a VOIP communications device 74. The test probe 
includes a reference voice file 7 6a and the VOIP 
communications device 74 has an embedded reference voice file 

10 76b. The test probe 72 can be functionally identical to the 
test probe 38 shown in FIG. 2. The test probe 72 and the VOIP 
communications device 7 6 each include a suitable interface to 
allow direct connection to the VOIP network 12 over an 
appropriate VOIP network connection 80, e.g., an Ethernet 

15 connection* Thus, in contrast to the topology shown in FIG. 
1, the topology 70 eliminates a second test by providing a 
voice file in a VOIP communications device having a codec to 
be evaluated. The VOIP communications device 76 can be any 
VOIP communications device that performs speech 

20 encoding/decoding in a particular VOIP network environment, 
for example, a gateway, a server, a telephone (like the 
gateway 16, VOIP server 34 and VOIP telephone, respectively, 
from FIG. 2), or any other VOIP communications device. 

In addition to the voice file 76, the VOIP 

25 communications device must also have a voice quality test 

support module 82 to enable the device to answer a test call 
by playing the voice file. As indicated in the figure, the 
module 82 can be implemented as an Interactive Voice Response 
(IVR) unit as is well known in the art. At present, many VOIP 

30 communications devices already include an IVR unit to support 
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other functions, such as interactive call processing 
functions. In those instances, the voice call listening 
quality test scheme is able to exploit a device' s inherent 
interactive voice response (IVR) capability. Alternatively, 
5 if the device does not include IVR functionality, then the 
device requires a script enabling that device to recognize a 
special phone number and understand that a call to that 
special phone number is to be answered by playing the embedded 
voice sample file. 
10 FIG. 6 illustrates an alternative VOIP-telephony 

network 90 generally configured in a similar configuration to 
Q that of the network 30 of FIG. 2, but modified so as to 
„5I require only one test probe to produce PAMS scores for the 
fJl voice call quality between the test probe and various 
tJ5 connection points around the VOIP network 12 according to the 

test topology 70 shown in FIG. 5. That is, and with reference 
II to FIGS- 2 and 6, the test probes 14 are eliminated by 
J'J embedding voice files (VF) 92 in the VOIP communications 
h:k devices to which the test probes 14 were coupled^, that is^ the 
ljf|20 gateways 16, VOIP server 34 and VOIP phone 35, shown with the 
^ embedded voice files in FIG. 6 as gateways 16', VOIP server 

34' and VOIP phone 36' . The test probe 38 is responsible for 
generating calls to the gateways 16a' , 16b' , 16c' and 16d' , as 
well as device 34' and 36' (on a scheduled basis under the 
25 control of the manager 44) and generating PAMS scores from the 
responses (that is, the playback of stored reference voice 
files) by the called devices 16';. 34' and 36'. The 
functionality of the manager 44 is as earlier described with 
respect to FIG. 2. 
30 Additions, subtractions, and other modifications of 
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the described embodiments of the invention will be apparent to 
those practiced in this field and are within the scope of the 
following claims. The test scheme and topology can be adapted 
to accommodate other different physical and signaling 
5 protocols. For example, the test probe 40 could be connected 
to an SS7 network, or the test probe 14 could connect to an 
SS7 or CAS gateway interface. Moreover, the packet-based 
network 12 need not be an IP network. The network 12 could be 
implemented as a Voice Over Frame Relay or Voice Over ATM 
10 network, and the interfaces and protocols supported by the 
test scheme could be modified accordingly . 
What is claimed is: 
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